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Abstract. We present a technique to control chaos in Hamiltonian systems which 
are close to integrable. By adding a small and simple control term to the perturbation, 
the system becomes more regular than the original one. We apply this technique to a 
model that reproduces turbulent E x B drift and show numerically that the control is 
able to drastically reduce chaotic transport. 
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In this article, the problem we address is how to control chaos in Hamiltonian systems 
which are close to integrable. We consider the class of Hamiltonian systems that can be 
written in the form H = Hq + eV that is an integrable Hamiltonian Hq (with action- 
angle variables) plus a small perturbation eV. 

The problem of control in Hamiltonian systems is the following one: For the per- 
turbed Hamiltonian Ho+eV, the aim is to devise a control term / such that the dynamics 
of the controlled Hamiltonian Hq + eV + / has more regular trajectories (e.g. on invari- 
ant tori) or less diffusion than the uncontrolled one. In practice, we do not require that 
the controlled Hamiltonian is integrable, but only that it has a more regular behavior 
than the original system. This allows us to tailor the control term following specific 
requirements. 

Obviously / = — eV is a solution since the resulting Hamiltonian is integrable. However, 
it is a useless solution since the control is of the same order as the perturbation. 

For practical purposes, the desired control term should be small (with respect to 
the perturbation eV) , localized in phase space (meaning that the subset of phase space 
where / is non-zero is finite or small enough), or / should be of a specific shape (e.g. a 
sum of given Fourier modes, or with a certain regularity). Moreover, the control should 
be as simple as possible in order to be implemented in experiments. Therefore, the 
control appears to be a trade-off between the requirement on the reduction of chaos and 
the requirement on the specific shape of the control. 

In this article, we apply the method of control based on Ref. |H] and developed 
in Refs. PUI2]- We implement numerically an algorithm for finding a control term / of 
order 0(e 2 ) such that H = Hq + eV + / is integrable. This control term is expressed 
as a series whose terms can be explicitly and easily computed by recursion. This ap- 
proach of control is "dual" with respect to KAM theory : KAM theory is looking at 
coordinates making the system integrable. In this method of control, we slightly modify 
the Hamiltonian such that the resulting controlled system is integrable. It is shown on 
an example of particles in a turbulent E x B field that truncations of this control term 
/ provide effective control terms that significantly reduce chaotic transport. We show 
that with an electric potential with several frequencies, the partial control potential is 
time-dependent (contrary to the one used in Refs. [UI2] and that it is able to drastically 
reduce the diffusion of test particle trajectories. 

2. Control theory of Hamiltonian systems. 

In this section, we follow the exposition of control theory developed in Ref. [S]. Let A 
be the Lie algebra of real functions of class C°° defined on phase space. For H E A, let 
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{H} be the linear operator acting on A such that 

{H}H' — {H, H'}, 

for any H' £ A, where {■ , •} is the Poisson bracket. The time-evolution of a function 

V £ A following the flow of H is given by 

which is formally solved as 

V(t) = e t{H} V(0), 
if H is time independent, and where 

00 4-n 
n=0 

Any element V £ ^4 such that {-ffjV^ = 0, is constant under the flow of H, i.e. 

Vt £ R, e* W \/ = 1/. 

Let us now fix a Hamiltonian if £ -4- The vector space Ker{if } is the set of constants 
of motion and it is a sub-Lie algebra of A. The operator {i?o} is not invertible since a 
derivation has always a non-trivial kernel. For instance {Ho}(Ho a ) = for any a such 
that H a £ A Hence we consider a pseudo-inverse of {-f^o}- We define a linear operator 
r on A such that 

{#o} 2 r = {h }, (i) 

i.e. 

W £ A {if , {# , TV}} = {Ho, V}. 

If the operator T exists, it is not unique in general. Any other choice T' satisfies that 
the range RgfT' — V) is included into the kernel Ker({H } 2 ). 

We define the non-resonant operator M and the resonant operator 1Z as 

M={H Q }Y, 
11 = 1 -Af, 

where the operator 1 is the identity in the algebra of linear operators acting on A. We 
notice that Eq. (JJJ becomes 

{H }n = 0, 

which means that KgR is included into Ker{H }. A consequence is that any element 
1ZV is constant under the flow of H , i.e. e^^TZV = TZV. We notice that when {H } 
and T commute, TZ and M are projectors, i.e. 1Z 2 = TZ and Af 2 = Af. Moreover, in this 
case we have KgTZ = Ker{H }, i.e. the constants of motion are the elements TZV where 

V £ A. 
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Let us now assume that H is integrable with action-angle variables (A, ip) e B x T n 
where B is an open set of M™ and T n is the n-dimensional torus, so that H = H (A) 
and the Poisson bracket {H, H'} between two Hamiltonians is 

ih h'\-— ^EL_^L <^L 

The operator {H } acts on V given by 

V = J2 ^(A)e* k -f, 

as 

{H }V{A,<p) = £>(A) -k F k (A)e ik ^, 

k 

where the frequency vector is given by 

" (A) = 9A- 

A possible choice of T is 

k6Z n V 7 

w(A)-k^O 

We notice that this choice of T commutes with {H }. 

For a given V <E A, 1ZV is the resonant part of V and AfV is the non-resonant part: 

nV = J2 Vk(A)xMA) ■ k = 0)e^, (2) 

k 

A/V = V k (A) X (w(A) • k ^ O)^", (3) 

k 

where vanishes when a is wrong and it is equal to 1 when a is true. 

From these operators defined for the integrable part H , we construct a control 
term for the perturbed Hamiltonian H + V where V G A, i.e. we construct / such that 
H + V + / is canonically conjugate to H + 1ZV . 

Proposition 1: For V E A and T constructed from H , we have the following equation 
e< ry > (H + V + f)=H + TZV, (4) 

where 

f(V) = e-^UV + {rv} AfV - V (5) 

We notice that the operator (1 — e~^ rv ^) / {TV} is well defined by the expansion 

l_ e -{rv} °^ (_i)n 

{TV} ^(n + 1)! 1 1 
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We can expand the control term in power series as 

(-1)" 
(n + l)\ 



(— 1 i n 

f( v ) = Y,T^-A TV ^ nn + l ) v - ( 6 ) 

n=l 



We notice that if V is of order e, f(V) is of order e 2 . 
Proof. Since e^ ry ^ is invertible, Eq. (jlj) gives 

f(V) = ( e -< rv > - 1)H Q + e-^>W - V. 

We notice that the operator e~^ rv ^ — 1 can be divided by {T^/} 

P -{rv} _ i 

f{V) = {rv} {TV}H + e-MKV - V 
By using the relations 

{TV}H = {TV, H } = -{H }TV, 

and 

{H }T = ^f, 

we have 

1 - p-i rv } 

f( V ) = e-^nV+ AfV-V. □ 

This result can also be obtained by using a perturbation series. 

Proposition 1 tells that the addition of a well chosen small control term / makes 
the Hamiltonian canonically conjugate to H + TZV. 

Proposition 2 : The flow of H + V + / is conjugate to the flow of H Q + TZV: 

Vt G R, e ^ Ho+v+ ^ = e^°> e'^ y > e^ rv \ 

The remarkable fact is that the flow of TZV commutes with the one of H , since 
{H }TZ = 0. This allows the splitting of the flow of H + TZV into a product. 



We recall that H is non-resonant iff 

VAGB, X (w(A).k = 0) = x(k = 0). 

If f^o is non-resonant then with the addition of a control term /, the Hamiltonian 
Hq + V + f is canonically conjugate to the integrable Hamiltonian H + TZV since 
is only a function of the actions [see Eq. (J2J)]. 

If ifo is resonant and 7?.^ = 0, the controlled Hamiltonian H = Hq + V + / is 
conjugate to H . 

In the case TZV = 0, the series © which gives the expansion of the control term /, can 
be written as 

oo 
s=2 
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where f s is of order e s and given by the recursion formula 

f a = -l{TV, /_!>, (8) 

where fi = V. 

Remark : A similar approach of control has been developed by G. Gallavotti in 
Refs. [HIS El- The idea is to find a control term (named counter term) only depending 
on the actions, i.e. to find N such that 

H(A, tp) = H (A) + V(A, if) - N(A), 

is integrable. For isochronous systems, that is 

H (A) = u> ■ A, 

or any function h(u> -A), it is shown that if the frequency vector satisfies a Diophantine 
condition and if the perturbation is sufficiently small and smooth, such a control term 
exists, and that an algorithm to compute it by recursion is provided by the proof. We 
notice that the resulting control term N is of the same order as the perturbation, and 
has the following expansion 

N(A) =TZV + hl{TV}V + 0{e 3 ), 

where we have seen from Eq. (J2J) that 1ZV is only a function of the actions in the 
non-resonant case where uj is non-resonant which is a crucial hypothesis in Gallavotti's 
renormalization approach. Otherwise, a counter-term which only depends on the actions 
A cannot be found. In what follows, we will see that the integrable part of the 
Hamiltonian is always resonant for the cases we consider, namely for the E x B drift 
motion in the guiding center approximation. 



3. Application to a model of E x B drift motion 



In the guiding center approximation, the equations of motion of a charged particle in 
presence of a strong toroidal magnetic field and of a nonstationary electric field are jHj 



x 



d ( 
dt\y 



B 



(9) 



where V is the electric potential, E = — VV, and B = Be z . The spatial coordinates 
x and y where (x,y) G M 2 play the role of the canonically conjugate variables and the 
electric potential V(x, y, t) is the Hamiltonian of the problem. To define a model we 
choose 

"2tt " 
— n ■ x + tp n — L){n)t , 



sin 



(10) 



where ip n are random phases and V n decrease as a given function of |n|, in agreement 
with experimental data In principle, one should use for u;(n) the dispersion relation 
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for electrostatic drift waves (which are thought to be responsible for the observed 
turbulence) with a frequency broadening for each n in order to model the experimentally 
observed spectrum [Oj S(n,u). 

By rescaling space and time, we can always assume that L = 2tt. In this article, we 
use a simplified potential. We keep the random phases in order to model a turbulent 
electric potential and we use a simplified broadening of the spectrum for each n. We 
consider the following electric potential : 

K N 

V(x,y,t) = y~] Y] k . sm(nx + my + (p kmn -uj k t), (11) 

k=l m,n=l v ' 

where fkmn are random phases. Here we consider a quasiperiodic approximation of 
the turbulent electric potential with a finite number K of frequencies. We assume that 
&k 7^ (see remark below). 

First we map this Hamiltonian system with l+K/2 degrees of freedom to an autonomous 
Hamiltonian with 1 + K degrees of freedom by considering that 9 k = uj k t mod27r are 
angles. We denote E k the action conjugate to 9 k . This autonomous Hamiltonian is 

H(x, y, 6, E) = uj ■ E + S~] Qfc sin(nx + my + ip kmn - 9 k ). (12) 

z — ' (n z + m z ) A i z 

k,m,n ' 

The integrable part of the Hamiltonian from which the operators T, TZ and M are 
constructed is isochronous 

H Q = u-E. 

We notice that H is resonant (since it does not depend on the action variable x). Also, 
we notice that the frequency vector u> is in general resonant since the potential contains 
also harmonics of the main frequencies. 
The action of I\ TZ and M on functions W of the form 



W(x,y,0) = J2W„(x,y)e il '- 9 , 



is 



YW = y ^^ x (u> ■ v ± 0)e- e , 

v 

UW = J2 W u (x, y) X {u ■ v = 0)e^ e , 

The action of T and TZ on the potential V given by Eq. (fTTf is 

Qfc 

u k (n 2 + m 2 ) 3 / 2 



TV = Y — ah , cos(nx + my + ^ kmn - 9 k ), 



k,m,n 

tzv = o. 
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From the action of these operators, we compute the control term using Eqs. (J7J) and (jSJ). 
For instance, the expression of f 2 is 

f 2 (x,y,t) = - 



4 ' uik(n 2 + m 2 ) 3 / 2 (n' 2 + m' 2 ) 3 / 2 

k,m,n y * v * 



(sin[(n + n')x + (m + m')y + <£w + y? fc ' m ' n ' - + ^fe')*] 
+ sin[(n - n')x + (m - ra')y + fkmn ~ fk'm'n' ~ (^k ~ u k ,)t\) . (13) 

Remark: Similar calculations can be done in the case where there is a zero frequency, 
e.g., Uq = and LOf. ^ for k ^ 0. The first term of the control term is 

f2 = -\{rv,(K + i)v}, 

where 

TZV = a ° , sin(nx + my + y?omn)- 

m,n v 7 

We implement numerically the control term by computing test particle trajectories in 
the original electric potential and the controlled potential obtained by adding f 2 to V. 
Even if Proposition 1 tells that the addition of the control term / makes the dynamics 
integrable, the numerical simulations are used to test the efficiency of some truncations 
of this control term which provide more tractable control potentials. 
In Refs. PU E] , the electric potential was chosen with only one frequency. It was shown 
that truncations of the control term are able to drastically reduce chaotic transport of 
charged test particles in this potential. It was also shown that approximations of this 
control term are still able to reduce chaos and provide simpler control potentials. In 
particular, it is possible to reduce the amplitude of the control term / 2 which means that 
one can inject less energy and still get sufficient control. Also it is possible to truncate 
the Fourier series of the control term and keeping only the main Fourier components of 
the control in order to get sufficient stabilization. We perform numerical experiments for 
an electric potential that contains two frequencies. For instance, we use two frequencies 
&i — 1 and LU2 — V% and ax = a and a 2 = a/2 where a ranges from 0.5 to 1. With 
the aid of numerical simulations (see Ref. [Zj for more details on the numerics), we 
check the effectiveness of the control by comparing the diffusion properties of particle 
trajectories obtained from Hamiltonian (|TT|) and from the same Hamiltonian with the 
control term (|T3*j) . Figures ^ and EJ show the Poincare surfaces of section of two typical 
trajectories (issued from the same initial conditions) computed without and with the 
control term respectively. Similar pictures are obtained for many other randomly chosen 
initial conditions. A clear evidence is found for a relevant reduction of the diffusion in 
presence of the control term (fT3*|) . 

In order to study the diffusion properties of the system, we have considered a set of 
M. particles (of order 100) uniformly distributed at random in the domain < x, y < 1 
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Figure 1. Poincare surface of section of a trajectory obtained for Hamiltonian 1)11(1 
assuming a = 0.8. 




-20- 
-30 

-5 5 10 15 20 25 

x 

Figure 2. Poincare surface of section of a trajectory obtained for the same initial 
condition as in Fig. ^ and adding the control term (|13f) to Hamiltonian (|llfl . 

at t — 0. We have computed the mean square displacement (r 2 (t)) as a function of time 

1 M 

( r2 ( t )) = ^S |Xi(t) " Xi(0)|2 

i=l 

where Xj(t), i = is the position of the i-th particle at time t obtained by 

integrating Hamilton's equations with initial conditions Xj(0). Figure H3 shows (r 2 (t)) 
for three different values of a. For the range of parameters we consider, the behavior 
of (r 2 (t)) is always found to be linear in time for t large enough. The corresponding 
diffusion coefficient is defined as 

t^oo t 

Figure H] shows the values of D as a function of a with and without control term. It 
clearly shows a significant decrease of the diffusion coefficient when the control term is 
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added. As expected, the action of the control term gets weaker as a is increased towards 
the strongly chaotic phase. Moreover, we notice that for a > 1.3 the diffusion is larger 
with control than without. 




t x m 4 

Figure 3. Mean square displacement (r 2 (t)) versus time t obtained for Hamiltonian 
with the control term H13JI for three different values of a = 0.7 (dotted line), 
a = 0.8 (dashed line), a — 0.9 (continuous line). 




a 



Figure 4. Diffusion coefficient D versus a obtained for Hamiltonian (|ii|l (open 
squares) and Hamiltonian 1)11(1 plus control term l|lrS[) (full circles). 
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